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The purpose of the present study is to evaluate the pre- 
dictive validity of the ACT assessment--the ACT tests and the 
non-academic achievement scales of the Student ProfUe Section. 
At 35 diverse institutions, students who had completed the ACT 
battery prior to college admission were surveyed for their aca- 
demic and non-academic accomplishments during their freshman 
year. Criteria included college grades, twelve scales designed 
to measure notable extra-classroom accomplishment in college, 
and one scale t- assess recognition for academic accomplishment. 
Predictors included scores on ACT tests, high school grades, 
and the six scales measuring non-academic accomplishment in 
high school. The results, which support our earlier findings, 
indicate that non-academic accomplishment can be assessed 
with moderate reliabUity, that both academic and non-academic 
accomplishment can be predicted to a useful degree, and that 

non-academic accomplishment is largely independent of academic 
potential and achievement. 



Predicting Student Accomplishment in College from the ACT Assessment 
James M. Richards, Jr. and Sandra W. Lutz 

In the interest of human and social values, educational 
institutions should be concerned with finding students who will 
do outstanding things outside the classroom and in later life as 
well as students who have the ability to get satisfactory grades. 

If we are to find such students, we need a better record of 
students' competencies and achievement during the high school 
years. Further, we should consider such measures important 
in their own right rather than weak supplementary measures 
to remedy the slight defects of conventional aptitude and achieve- 
ment tests. 

The Student Profile Section was added to the ACT battery 
in the fall of 1965 to fill this need in part. It is a short 
biographical inventory containing the kind of information often 
requested in college application blanks. However, it collects 
and reports this information in a more systematic fashion than 
do similar institutional forms. Specifically, it gives the student 
the opportunity to tell the prospective colleges about his aspira- 
tions, goals, anticipated personnel needs (such as housing and 
financial aid), and non-classroom achievements. 

The purpose of the present study is to evaluate the predictive 
validity of the ACT Assessment- -the ACT tests and the non-aca- 
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demic achievement scales of the Student Profile Section. The 
ACT tests have been validated many times (American College 
Testing Program, 1965, 1966; Munday, in press) and the validity 
of similar non-academic accomplishment scales has been sttidied 
(Richards, Holland, & Lutz, 1966b). The present study is the 
first, however, to assess simultaneously the predictive validity 
of measures of academic and non-academic accomplishment obtained 
as part of a college admissions testing program. Thus it is a 
replication and extension, in a diverse group of two- and four- 
year colleges, of our previous research on the relationships 
among non-academic accomplishment, academic potential, and 
academic accomplishment (Holland, 1961; Holland & Astin, 1962; 
Holland & Nichols, 1964; Holland & Richards, 19b5, 1966; Richards 
1966a, 1966b). 

Method 

Predict^ors 

The predictive variables included the following measures: 

ACT Tests. The test battery, a college admissions test 
administered nationally, yields the following sabtest scores: 

English, mathematics, social studies and natural science. Each 
score is converted to a common scale with a mean of approxi- 
mately 20 and a standard deviation of about 5 for college -bound 
high school seniors. The reliabilities of the ACT tests (American 
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College Testing Program, 1965), the high correlations between 
the ACT battery and other similar measures (Eells, 1962), and 
the similar relationship of the ACT battery and of similar measures 
to college grades (Munday, 1965) all indicate that the ACT battery 
is a typical measure of academic potential. Therefore, we would » 
not expect markedly different results in the present study if we 
had used some other academic test or test battery. 

High School Grades. As a regular part of the ACT procedure, 
persons taking the ACT battery report the grades they have received 
in high school courses in four areas: English, mathematics, social 
studies, and natural science. Research by Davidsen (1963) indicates 
that, in a large sample, such self-reported grades correspond closely 
to the high school transcripts. A reanalysis of Davidsen' s data 
yielded a correlation of . 92 between student- reported and school- 
reported grades. The measure used in the present study is the 
overall average on a four-point scale (A = 4, B = 3, etc .) of 
all grades reported. In another study by Hoyt (1963) the predictive 
efficiency of average self-reported grades equaled the predictive 
efficiency of the student's rank in the high school class obtained 
from his transcript. 

Non-Academic Achievement Scales. A checklist of extra- 
curricular accomplishment was developed to obtain scores in the 
following areas: leadership, music, drama and speech, art, writing, 
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and science. Each scale consisted of eight items ranging from 
common and less important accomplishments to rarer and more 
important ones. For example, science items included such 
accomplishments as "performed an independent scientific exper- 
iment" or "won a prize or award of any kind for scientific work 
or study. " In general, the accomplishments involve public action 
or recognition, so that in principle the accomplishments could 
be verified. The score on each scale is simply the number of 
accomplishments the student marks "Yes, applies to me." Students 
with high scores on one or more of these simple scales presum- 
ably have attained a high level of accomplishment, which requires 
complex skills, long-term persistence, or originality. These 
scales are discussed in detail elsewhere (American College 
Testing Program, 1965; Holland & Richards, 1966). 

Criteria of Achievement 

The criterion variables included the following measures: 

College Grades. Each student reported his grade average 
for his last college term by checking one of the following alterna- 
tives: D or lower, D+, C, C+, B, B+, A or A+. Scores from 1 to 7 
were assigned to these alternatives so that a high score indicates 




high grades. Also, as a check on the accuracy with which students 
reported their accomplishments, the colleges were asked to report 
the grade average for each student on a standard four-point scale 
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where A = 4, 00, B = 3, 00, C = 2, 00, D = 1, 00, and a failing 
grade = 0. 00. 

Non- Classroom Achievement Record. We usea a checklist 
of non-academic accomplishments to measure achievement in the 
following areas: leadership, social participation, art, social service, 
science, business, humarities, religious service, music, writing, 
social science, and speech and drama. We also developed a 
simple scale to determine public recognition for academic attainment 
in college. Each scale is, in a sense, a criterion or standard 
of accomplishment in an important area of human endeavor. A 
detailed account of the rationale, development, and statistical 
characteristics of these scales is presented elsewhere (Richards 
et , 1966a, 1966b). 

Each scale includes ten items, except the Recognition for 
Academic Accomplishment Scale which has five items. In re- 
sponding to the items, the student marks "yes" for those accom- 
plishments which he has achieved during college and "no" for those 
which he has not achieved. The score on each scale is simply the 
number of "yes" responses. 

Items range from common and less import?.nt accomplishments 
to rare and more important ones. For example, leadership accom- 
plishments included: elected to one or more student offices, active 
member of four or more student groups, served on a student- 
faculty committee. Music accomplishments included: composed or 
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arranged music which was publicly performed, publicly performed 
on two or more music instruments, attained a first division rating 
in a state or regional solo music contest. The remaining scales 
consisted of similar items with content appropriate to the various 
areas of achievement. In c.neral, the accomplishments involve 
public action or recognition, so that, in principle, they could be 
verified by comparing student self-reports with public records. 

We assumed that the possibility of verification would lessen student 



exaggeration. 

The non-classroom achievement scales were administered as 
part of a comprehensive follow-up of the Student Profile Section. 
We used a special questionnaire, so that students could mark their 
answers to questions directly on the questionnaire booklet. The 
entire booklet was then run through an optical- scanner scoring 
machine. ^ The follow-up questionnaire elicited information about 
a college student's achievements, goals, satisfactions, living 
circumstances, and self-evaluated change since entering college. 



The Sample 

The Student Profile Section follow-up was administered m 
the spring of 1966 to students completing their freshman year at 
thirty-five colleges. Fourteen of these colleges were two-year 

^The layout of these forms was developed and the scormg was 
performed by National Computer Systems, Minneapolis, nines 
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colleges, and twenty-one offered four year? of undergraduate 
education. These colleges were chosen from institutions partic- 
ipating in act's 1966 Class Profile Research Service (American 
College Testing Program, 1966). The particular colleges included 
are listed in Table 1. 

Table 1 

Colleges Included in the Sample 



Two-Year Colleges 



Fresno City College, California 
Hartnell College, California 
Santa Rosa Junior College, 
California 

Otero Junior College, Colorado 
Thornton College, Illinois 
Fort Dodge Community College, 
Iowa 

St. John's College, Kansas 



Lake Michigan College, Michigan 
Mary Holmes Junior College, 
Mississippi 

Murray State Agricultural College, 
Oklahoma 

Community College of Philadelphia, 
Pennsylvania 
Panola College, Texas 
College of Eastern Utah 
Potomac State College, West Va. 



Four-Year Colleges 



La Sierra College, California 
Illinois Teachers College; 

Chicago South 
Illinois College 
University of Illinois 
Central College, Iowa 
William Fen. College, Iowa 
Wichita State University, Kansas 
Mount St. Mary's College, 
Maryland 

Michigan Technological University 
Chadron State College, Nebraska 
New Mexico Highlands University 



Bluffton College, Ohio 
Langston University, Oklahoma 
Mount Marty College, 

South Dakota 

South Dakota School of Mines 
and Technology 
Tennessee State University 
Tusculum College, Tennessee 
McMurry College, Texas 
Midwestern University, Texas 
North Texas State University 
Wisconsin State University 
at Stevens Point 




It would be helpful to know the extent to which these colleges 
are like American colleges in general. Astin (1965) recently 
published a comprehensive description of the "environments" of 
1015 four-year colleges in terms of eight characteristics: selectivity, 
size, and six "personal orientations" --Realistic, Intellectual, Social, 
Conventional, Enterprising, and Artistic- -based on the proportion 
of students in each of six classes of major field (Holland, 1966; 

Astin & Holland, 1961). Astin reports scores for colleges on these 
variables using a standard scale with a mean of approximately 50 
and a standard deviation of approximately 10. 

A description of junior college environments has also been 
published (Richards, Rand, & Rand, 1965, 1966). Through factor 
analysis, a brief profile was developed for describing junior 
college environments. This profile consists of six factors: Private 
Control (or Cultural Affluence), Techi*.ological Specialization, Size, 
Conventionalism (or Age), Transfer Emphasis, and High Cost 
(or Business Orientation). Estimated scores on these factors 
are available in the form of stanines (Guilford, 1956, p. 503), 
which are normalized standard scores, ranging from 1 to 9, with 
a mean of 5 and a standard deviation of 1. 96. 

Of the colleges in this sample, 13 two-year colleges and 
19 four-year colleges are included in these lists. We computed 
means and stando rd deviations for these colleges on the environmental 
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description scales. Results are summarized in Table 2. These 
results show that, in a number of cases, the mean for the sample 
•'dleges deviates from the all -college mean by half a standard 
deviation or more. The pattern of differences is consistent with 
the type of college using ACT services. Therefore, it appears 
that our sample is more representative of ACT colleges than of 
colleges in general. 

Table 2 



Mean and Standard Deviation of Sample Colleges 
on Environmental Description Scales 





Mean 


S. D. 


Two-Year Colleges 
(N = 13) 


Private Control 


5. 1 


1.4 


(Cult. Aff. ) 


Tech. Special. 


5. 1 


1. 3 


Size 


5.8 


1.4 


Conventionalism 


6. 1 


1.4 


(Age) 


Trans. Emph. 


6. 1 


1. 3 


High Cost 


4.6 


1.4 


(Bus. Orientation) 

Four- Year Colleges 
(M = 19) 


Selectivity 


45. 11 


7. 43 


Size 


51. 11 


10.47 


Realistic Or. 


54. 42 


9. 22 


Scientific Or. 


52.95 


9. 36 


Social Or. 


48. 58 


9. 50 


Conventional Or. 


51.84 


8. 55 


Enterprising Or. 


48.47 


7. 52 


Artistic Or. 


46. 79 


8. 59 



Note. --Environmental description scales are taken from .lichards, 
Rand, & Rand (1965, 1966) for two-year colleges and from Astin 
(1965) for four-year colleges. 



For each college, the investigators picked a group of students 
to be included in the follow-up. The procedure for selecting students 
is a compromise between a sample representative of students and 
a sample representative of institutions. Specifically, at small 
institutions all freshmen were followed up, and at large institutions 
a sample of freshmen were followed up.^ At large institutions, 
the sample was drawn by taking every n^ name on the Class Profile 
Service roster, with n chosen so that no more than 475 students 
from any one institution would be followed up. The total number 
of students followed up was 8908. The number of students at 
individual institutions ranged from 33 to 471 with a median of 

251. 

We sent i. questionnaire stamped with the name of each student 
to be followed up to his college, together with a roster of students 
on which the college indicated coRege GPAs and the current status 
(e, g. , enrolled but did not respond, no longer enrolled, ) 

of students in the sample who did not complete the questionnaire. 

Cach college war responsible for the administration of the follow-up 
questionnaire. Several techniques were used to contact students: 
some colleges had students fill out the questionnaire in English 
classes, convocations, or other group sessions; other colleges 
polled their students by mail. Complete follow-up data were obtained 
for 5695 freshmen (3267 males and 2428 females). Students with 

^The sample is restricted, of course, to those freshmen who 
took the ACT battery. 
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missing follow-up data include both 1441 students who left college 
and 1772 students still enrolled in college who failed to complete 
the questionnaire. The return rates at individual colleges ranged 
from 18. 0% to 92. 7% with a median of 74. 0%. The rates of return 
at individual colleges for students still enrolled ranged from 22. 6% 
to 100% with a median of 87. 7%. 

Although the return rate is fairly high, it is important to 

know what biases there may be in the sample with follow-up data. 

Accordingly, we computed the mean and standard deviation on each 

of the predictor variables for each of three groups: students with 

follow-up data, students still enrolled who failed to complete the 

3 

follow-up questionnaire, and students no longer enrolled. We 
also computed 'T' tests between students with follow-up and each 
of the other two groups. While no overall analyses of variance were 
computed, and while each test is not completely independent of 
every other test (some of the variables are correlated to a 
substantial degree), for the purpose of this study any error intro- 
duced is conservative since it is more likely that a number of 
significant differences will be found between students with and 
without follow-up data. Results are summarized in Table 3. 

The primary trend in Table 3 is for students who are no — — 

longer in school to have lower ACT ^scfij^e^'-aird high s»^iiool grades 
than students ^Ith-^-fcillow -up data. This is to be expected, of course, 

^These computations were carried out at Measurement Research 
Center, University of Iowa. 
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since many students leave school In their freshman year because 
of academic failure. Males who left school also tended to be 
lower on the non-academic accomplishment scales. No consistent 
pattern appeared for the comparison of students still in school with 
and without follow-up data. 

Table 3 



Comparison of Students With and Without Follow-up Data 

on Predictor Variables 



Variables 



With 

F -up Daca 


In School 
No Data 


No longer 
in School 


t tests 


Mean S. D. 


Mean S. D. 


Mean S. D. 


1 vs. 2 1 vs. 3 



Males 

ACT English 17.6 


5. 5 


17. 7 


5.0 


15.4 


5. 5 


. 55 


** 

10. 70 
13. 28 


ACT Math 21.0 


6.9 


20.8 


6.3 


17.8 


6. 3 


.87 


ACTSoc. Stu.20. 6 


6.7 


20. 9 


6.2 


17. 7 


7.0 


1. 34 




ACT Nat. Sci. 20. 9 


6.7 


21. 1 


6. 1 


18.8 


6.7 


.90 


8.37 


HS GPA 2. 59 


. 68 


2.42 


.69 


2.22 


.64 


6* 94** 
3.91** 


15. 10** 


HSLead.Ach.2. 22 


1. 90 


1.93 


1.80 


1. 78 


1.80 


5. 46** 


HS Music 1. 19 


1. 70 


1. 18 


1.89 


1. 12 


1.80 


. 13 


.89 


HS Drama 1. 06 


1.41 


.84 


1. 36 


.90 


1. 37 


3.95** 


2. 63** 


HS Art .42 


1.02 


. 55 


1. 20 


. 55 


1. 18 


2. 77** 


2. 60** 


HS W riting . 6^t 


1. 07 


. 53 


.96 


. 53 


.98 


2. 84** 


2. 52* 


HS Science .90 


1. 37 


.88 


1.42 


. 77 


1. 24 


. 34 


2. 30 


F emale s 

ACT English 19.0 


5- 5 


19. 3 


4.9 


17. 3 


5.7 


1. 38 


5.81** 


ACT Math 17.0 


6.6 


16. 5 


5.8 


14. 6 


6.0 


1.94 


7. 62** 


ACT Soc. Stu. 19. 4 


7.0 


19.8 


6. 4 


17. 6 


6. 5 


1.42 


5. 30** 


ACT Nat. Sci. 18. 6 


6. 3 


18.9 


5.9 


16.6 


5.9 


4. 15 


6.49** 

** 

9.81 


HS GPA 2.80 


.66 


2. 69 


.66 


2.49 


. 61 


HS Lead. Ach.2. 32 


1.82 


2. 23 


1.89 


2. 19 


1. 90 


.98 


1. 16 


HS Music 1.*’8 


1.82 


1.82 


1.91 


1.65 


1.84 


.43 


1. 19 


HS Drama l.< 2 


1. 52 


1.34 


1.48 


1. 52 


1. 57 


1. 11 


1.08 


HS Art . £2 


1.06 


. 53 


1. 11 


. 65 


1.27 


. 19 


1. 75 


HS Writing 1.C6 


1. 28 


.95 


1. 30 


.98 


1. 22 


1. 74 


1.08 


HS Science . 48 


1. 01 


. 54 


1.06 


.42 


.92 


1. 18 


1.08 



*P<.05, ’‘*P<.01 
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Because the Ns in this study are very large, a small absolute 
difference can be highly significant. For the most part, the actual 
differences are small, relative to the standard deviations. Moreover, 
a full range of talent is present in the groups with follow-up data. 

It appears unlikely, therefore, that the results of this study are 
seriously distorted by differences between students with and without 
follow-up data. 

The non-academic achievement scales rest on student self-reports, 
and the memory and honesty of students are important. In particular, 
we should check the effect of a student's exaggerating his achievements. 
Therefore, we developed two special scales, the Infrequency Scales, 
one for high school achievements (Holland & Richards, 1966), and one 
for college achievements. The rationale for these scales is that a 
student who is exaggerating his achievements is likely to claim rare 
accomplishments in several different :v/eas. Accordingly, by combining 
male and female data, we identified the item on each achievement 
scale claimed least frequently. The score on the Infrequency Scale 
is simply the number of these rare achievements claimed by the 
student. 

The relationships between the high school Infrequency Scale and 
the predictoi variables have been reported in detail elsewhere (Holland 
& Richards, 1966). As a check on the influence of exaggeration in 




the present study, we identified students with high scores on either 
or both of the Infrequency Scales (a high score was defined as a 
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score of 4 or higher). Among students with follow-up data, 78 had 
high Infrequency scores --49 male and 29 female-- or about 1% of the 
sample. We made the basic computations for this study twice, first 
including all students, and second excluding students with high 
Infrequency scores. 



Results 

The mean and stcmdard deviations of the college achievement 
scales for the various groups are summarized in Table 4. Different 
units were used for the two college GPA variables; colleges reported 
GPAs on a four-point scale while students estimated their overall 
GPA by responding to a seven-alternative question. The distri- 
butions of the non-academic accomplishments are highly skewed and 

almost dichotomous, so that the standard deviations are larger than 
4 

the means. This skewness occurs because each scale contains 
accomplishments that are rare among college freshmen (the modal 
number of accomplishments on most scales is zero). Differences 
among the areas of accomplishment probably reflect differences 
both in the level of accomplishment represented by the various items 
and in the opportunity for various kinds of achievement in college. 
The results with high Infrequency students eliminated suggest that 



The skewness of such distributions has had little effect in 
previous studies, however, on Pearson correlations involving similar 
variables (Holland & Pachards, 1965), It is possible that the results 
of this study are distorted by the use of skewed, almost dichotomous 
-variables in multiple regression analysis, although the consistency 
and meaningfulness of our results suggest that such distortion is 
unlikely. 
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student exaggeration had little effect on the findings. 

Table 4 

Means and Standard Deviations for College Achievement Scales 



All Students High Infre. Students Elim. 

Males Females Males Females 





Mean 


S. D. 


Mean 


S. D. 


Mean 


S. D. 


Mean 


S. 


D. 


Coll. GPA 


2. 18 


.69 


2.38 


. 70 


2. 18 


.69 


2.38 


• 


70 


(C. Rep. )a 
Coll. GPA 


3.65 


1.27 


3.98 


1. 27 


3.65 


1. 27 


3.98 


1. 


27 


(Stu. Rep. 
Rec. A. Ach. 


. 17 


. 50 


.19 


. 51 


.16 


.49 


.19 


• 


51 


Lead Ach 


.47 


1. 19 


. 53 


1. 11 


.46 


1. 14 


, 53 


1. 


10 


Mus Ach 


.20 


.75 


. 18 


.60 


. 19 


. 70 


. 18 


• 


59 


SpandDr Ach 


1 .25 


.80 


.31 


.92 


.24 


. 75 


.31 


• 


92 


Art Ach 


.45 


1. 03 


.59 


1. 04 


.43 


.96 


. 58 


1. 


04 


W rit Ach 


.26 


. 74 


.38 


.79 


.25 


.67 


.38 


• 


78 


Sci Ach 


.19 


. 63 


.06 


. 31 


. 19 


. 58 


.06 


• 


31 


Soc Par 


.72 


1. 26 


.66 


1. 10 


.71 


1. 20 


.66 


1. 


10 


Soc Ser Ach 


. 54 


1. 06 


.75 


1. 11 


. 53 


1.02 


.74 


1. 


11 


Bus Ach 


.61 


.92 


.28 


. 58 


.60 


.88 


.28 


• 


58 


Hum-Cul Ach 


.93 


1. 26 


1. 18 


1. 35 


.92 


1. 23 


1. 17 


1. 


34 


Rel Ser 


1. 19 


1.96 


1. 77 


2. 20 


1. 19 


1.94 


1. 76 


2. 


19 


Soc SciAch 


.29 


. 68 


.25 


. 57 


.28 


.62 


.25 


• 


55 



ct 

Colleges reported grades on a 1.00 to 4.00 scale, while 



students reported grades by answering a seven-alternative question. 



As a next step, correlations were computed among all variables, 

5 

both preiictor and criterion. A missing data program was used 
because some students failed to complete all scales. The results 
for all students are reported in Table 5 and results with the high 
Infrequency students eliminated, in Table 6. Correlations for males 

5 

These computations were carried out at the University of Utah 
Computer Center. 
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are presented above the diagonal and correlations for females below it. 
In general, there are (1) moderate correlations among measures of 
academic potential and performance, (2) moderate, but lower, 
correlations among non-classroom achievements in the same or 
closely related areas, (3) low to moderate relationships among 
non- classroom achievements in areas which are not closely related, 
and (4) low relationships between non-classroom achievements and 
measures of academic potential and performance. These relation- 
ships are consistent with what previous investigators have found 
(Holland, 1958, 1959, I960, 1961; Holland & Astin, 1962; Nichols 
& Holland, 1963; Holland & Nichols, 1964; Holland & Richards, 

1965; Richards 1966b). 

The main effects of excluding high Infrequency students are 
to increase the correlations among non-classroom achievements in 
the same area, to decrease the correlations among non-classroom 
achievements in different areas, and to leave the correli-tions between 
academic and non-classroom accomplishment unchanged. These 
results again suggest that student distortion of achievement had 
little effect on our results. The results also suggest that most 
students give a frank account of their accomplishments. Further 
evidence for this is provided by the high correlations between 
college -reported and student- reported college GPA. Since the 
students merely estimated their overall average on a seven- alter- 
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native question, these correlations are probably close to the limits 
imposed by the reliabilities of the variables. 

The correlations in Tables 5 and 6 are based on combining stu- 
dents at the various colleges into a single group. Although it seems 
unlikely, the obtained relationships may be artifacts of combining 
students in different colleges. The most important relationships for 
this study are those between academic and non-academic achievement 
and those between non-academic achievement in the same area in 
high school and college. Information about these relationships at 
individual colleges is summarized in Table 7. The data in Table 7 
are restricted to males at the 34 colleges having 25 or more students 

with complete data and with high Infrequency students eliminated. 

Table 7 



Relationships between High School and College Achievements 

at Individual Colleges 

(Males with High Infrequency Students Eliminated) 





HlghSchoolGPA 


Corresponding HS 
Non-Aca. Ach. Sc. 


Range 


Median 


Range 


Median 


College GPA (Rep by coll. ) 


14 to 75 


47 


— 


— 


Recognition Aca Acc 


-20 to 62 


24 


— 


— 


Coll. Leadership Ach 


-21 to43 


05 


-23to 53 


24 


Coll. Musical Ach 


-23 CO 12 


-03 


0to73 


39 


Coll. Sp & Dr Ach 


-24 to 15 


-02 


-13to 56 


32 


Coll. Art Ach 


-21 to 20 


-05 


09 to 77 


41 


Coll. Writ Ach 


-25 to 23 


04 


-10to65 


30 


Coll. Sci Ach 


- 2 6 to 2 1 


05 


-01 to 74 


28 



The results in Table 7 indicate that there is, indeed, considerable 
variation among colleges in the relationship between individual predictors 
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and individual criteria. However, the median correlations in Table 7 
are very close to the corresponding correlations in Table 6, which 
were calculated using all students combined. Moreover, the 
differences among colleges apparently are more random than con- 
sistent and meaningful. These results suggest, therefore, that 
combining students from different colleges has not distorted the 
relationships between variables, and that, in fact, the correlations 
based on the combined students are the best estimates of these 
relationships. ^ Inspection of the correlations at individual colleges 
for the other variables in this study and for females supported 
this interpretation. 

As a next step, we computed multiple correlations by selecting 
the most efficient predictors of each criterion. In previous research, 
we found that sophisticated computer procedures using F tests for 
significance in reduction of residual variance are not entirely 
satisfactory when the N is large, because many variables which 
produce a statistically significant reduction in residual variance 
have no practical effect on the size of the multiple correlation. 
Accordingly, in the present study we selected predictors by using 

^Another possibility is that combining students is justified, but 
two-year and four-year colleges should be treated separately. As a 
check on this possibility, correlation matrices were computed for the 
two groups of colleges and are presented in the Appendix. Only minor 
variations were obtained, a further indication that combining students 
from all colleges is appropriate. 
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the Wherry-Doolittle procedure and retaining variables which 
increased the shrunken multiple correlation by at least .01. 

The beta weights and multiple correlations for the academic 
criteria--college GPA and Recognition for Academic Accomplishment- - 
are shown in Table 8. For all measures of academic accomplishment 
the best predictor is high school grades, and some weighted combina- 
tion of high school grades and ACT test scores is a slightly better 
predictor than high school grades alone. This finding is consistent 
with a large number of previous investigations of the prediction 
of academic performance (American College Testing Program, 1965). 

Table 8 




Beta Weight-; and Multiple Correlations 
for Predicting Academic Accomplj^h£][lgRi 



Men Women 



Criterion 


Predictors 


Beta 


R 


r‘r edictors 


Beta 


R 


College GPA 
(Coll. Rep. ) 


High School G 
ACT Soc Stu 


PA 3580 
1790 


50 

55 


High School GPA 
ACT Eng 


4313 

2861 


54 

60 




ACT Math 


1536 


57 








College GPA 
(Stu. Rep. ) 


HS GPA 
ACT Soc Stu 


3933 

1966 


47 

50 


HS GPA 
ACT Eng 


4301 

2366 


52 

56 


Rec. Aca. Arc. 
(AllGcudents) 


HS GPA 
ACT Math 


2523 

1014 


30 

31 


HS GPA 
HS Sci Ach 
ACT Math 


2014 

1129 

0943 


25 

27 

29 


Rec. Aca. Acc. 
(H\gh Infre. 
Studtnts 
Elim. ) 


HS GPA 
ACT Math 


2403 

1271 


30 

32 


HS GPA 
HS Sci Ach 
ACT Math 


2000 

1044 

0918 


25 

27 

28 



Note. -In this and the following three tables, only variables 
increasing the shrvmken multiple correlation by at least . 01 are 
retanied. The correlation shown beside each variable is the multiple 
correlation with the designated criterion of that variable plus those 
listed above it. 
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The results for the Recognition for Academic Accomplishment 
scale are especially important. This scale is a self-report of 
achievements exactly comparable tc the non- classroom achievement 
scales, and it shares their statistical defects of extreme skewness 
and many zero scores. Furthermore, the items for this scale were 
mixed with items from the non-academic achievement scales in the 
same section of the follow-up questionnaire. Unlike the non-classroom 
achievement scales, however, this scale was designed so it should 
be correlated with academic achievement. Because this scale was 
moderately correlated with academic predictors, these results militate 
against the hypothesis that the low correlation between academic and 
non-academic accomplishment is entirely due to response bias, 
dissimulation, statistical defects of the non-academic achievement 
scales, or similar occurrences. The lower correlations for this 
scale than for grades may indicate only that not all students with 
high grades receive public recognition, especially during their 
freshman year. 

Some non-academic achievement scales --leader ship, music, 
speech and drama, art, writing, and science- -were desig.ied 
specifically to assess at the college level the same kinds of non- 
classroom achievement measured by the high school scales. The 
beta weights and multiple correlations for these criteria for men 
are summarized in Table 9 and those for women, in Table 10. 



o 
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Table 9 

Beta Weights and Multiple Correlations 
for Predicting Criteria of Non-Academic Accomplishment 
Highly Comparable to the High School Achievement Scales 
(Males) 





All Students 




High Infrequency Stu. Elim. 


Criterion 


Predictors 


Beta 


R 


Predictors 


Beta 


R 


C. LeadAch 


HS Lead Ach 




23 


HS LeadAch 


2102 


25 










HSWritAch 


1206 


27 


C. Mus Ach 


HS Music Ach 


3567 


32 


HS Mus Ach 




38 




HS Writ Ach 


-1048 


33 








C* Sp&Dir .A.ch 


HS Drama 


2053 


21 


HS Drama 




27 




ACT Math 


-0777 


22 








C. Art Ach 


HS Art Ach 




3i 


HS Art Ach 


— — 


41 


C. Writ Ach 


HSWritAch 




22 


HSWritAch 




32 


C. SciAch 


HS SciAch 


2410 


21 


HS SciAch 




28 




HS Drama 


-0816 


22 












Table 


10 












(Females) 










All Students 




High Infrequency Stu. Elim. 


Criterion 


Predictors 


Beta 


R 


Predictors 


Beta 


R 


C. LeadAch 


HS LeadAch 


1623 


20 


HS LeadAch 


1759 


21 




HSWritAch 


0967 


22 


HSWritAch 


1002 


23 


C. Mus Ach 


HS Music Ach 


3567 


35 


HS Music Ach 


3762 


37 




ACT Engl' -=h 


-1114 


37 


ACT English 


-1026 


38 


C. Sp&Dr Ach 


HS Drama 


2904 


26 


HS Drama 




28 




HS SciAch 


-0846 


27 








C. Art Ach 


HS Art Ach 




34 


HS Art Ach 


4084 


42 










HSWritAch 


1051 


43 


C. Writ Ach 


HSWritAch 


2837 


30 


HS Writ Ach 


3000 


35 




HS Drama 


1261 


31 


HS Art Ach 


1019 


37 




HS SciAch 


-1017 


33 


HS Drama 


1078 


38 


C. SciAch 


HS SciAch 




21 


HS SciAch 


2476 


26 










HS W rit Ach 


0829 


27 
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The results in Tables 9 and 10 underline the great importance 
of specific content in predicting achievement and strengthen earlier 
findings (Richards ^ ^ , 1966b). In each case, the best predictor 
of achievement in college is similar achievement in high school; 
and in many cases similar high school accomplishment is the only 
variable contributing to the prediction of college accomplishment. 
Moreover, in the remaining cases, the prediction of non-academic 
accomplishment is improved only slightly by adding variables to 
the corresponding high school scale- -an improvement likely to 
disappear on cross-validation. These findings are consistent, of 
course, with a substantial literature showing that past performa^^cc 
predicts future performance. Th#» information in Tables 9 and 10 
also coxifirms earlier findings that academic potential and success 
contribute little or nothing to the prediction of non-classroom success 
(Astin, 1962; MacKinnon, i960; Torrance, 1963; Taylor, Smith & 
Ghiselin, 1963; Price, Taylor, Richards, & Jacobsen, 1964; Gough, 
Hall, & Harris, 1963; Hoyt, 1965; Thorndike & Hagen, 1959). 

The results in these tables show further that the only major 
change resulting from the elimination of high Infrequency students 
is some increase in the predictive validity of the high school achieve- 
ment scales. Overall, the results with the high Infrequency students 
eliminated indicate that a tendency of a few students to exaggerate 
their accomplishments may change some of the details of the rela- 
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tionships among academ:ic potential, academic achievement, and 
non-academic accomplishment, but this tendency will not change 
the main patterns and interpretations of such relationships. 

The remaining criteria make our assessment of college student 
accomplishment more comprehensive; but they were not planned 
specifically to measure achievement in the same areas in high 
school. They include: social participation, social service, business, 
humanistic -cultural, religious, and social science achievf»mcnt. 

Table 11 shows what high school assessments predict these criteria 
of college achievement. The exact magnitude of the correlations is 
less of an issue for these criteria, and eliminating the high Infre- 
quency students seems to reduce error somewhat. Therefore, high 
Infrequency students were excluded from the computations summarized 
in Table 11. 

Table 11 

Beta Weights and Multiple Correlations 
for Predicting Criteria of Non-Acade.-vir. Accomplishment 
Not Highly Comparable to the High Schoo Achievement Scales 
(High Infrequency Students Eliminated) 





Men 






Women 






Criterion 


Predictors 


Beta 


R 


Predictors 


Beta 


R 


C. Soc Par 


HS Lead Ach 


2403 


29 


HS Lead Ach 


1907 


24 




HS Writ Ach 


1507 


32 


HS Writ Ach 


1414 


26 










ACT English 


-1191 


29 


C. Soc Ser Ach 


HS Lead Ach 


1211 


16 


HS Lead Ach 


1190 


17 




HS Drama 


1052 


19 


HS Sci Ach 


0930 


19 










HS Writ Ach 


0950 


21 










ACT Math 


-0865 


23 



ERIC 
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Table 11 (cont. ) 



W omen 



Criterion 


Predictors 


Beta 


R 


Predictors 


Beta 


R 


C. Bus Ach 


HS GPA 


-0937 


09 


HS Lead Ach 


0693 


07 


C. Hum-Cul 


HS Drama 


0747 


12 


ACT English 


-0693 


10 


Ach 


HS Writ Ach 


2178 


26 


HS Writ Ach 


2350 


27 




Sci Ach 


1503 


29 


HS Sci Ach 


1355 


30 




ACT Math 


-2197 


31 


HS Art Ach 


1041 


32 




ACT Soc Stu 


1732 


33 


ACT Math 


-1685 


34 










ACT Soc Stu 


1207 


35 


C. Rel Ser 














HS Drama 


1081 


14 


HS Drama 


1159 


14 




ACT Math 


-1050 


17 


ACT English 


-1342 


17 




HS W rit Ach 


0753 


19 


HS Music Ach 


0775 


19 


C. Soc Sci Ach 








HSGPA 


0778 


20 




HS Writ Ach 


1474 


16 


ACT English 


-1629 


13 




act Math 


-1568 


21 


HS Writ Ach 


1454 


20 




HSSci Ach 


0984 


24 


HS Art Ach 


0957 


22 


As was 


expected, the 


multiple 


correlations in Table 


1 1 are 





somewhat lower than the correlations in Tables 9 and 10, and one 
would expect them to drop further on cross-validation. Consequently, 
a better approach to predicting these variables probably is to 
construct a high school achievement scale corresponding closely to 
the college achievement scale. lor the most part, the correlations 
in Table 11 support the conclusion that high scores on academic 
predictors tell little about a student's potential for non-classroom 
accomplishment. 
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Discussion 

This study lends further support to our research to establish 
that some non- academic accomplishments are independent of aca- 
demic potential and accomplishment (Holland & Richards, 1965, 1966), 
that non-academic accomplishment can be assessed with moderate 
reliability (American College Testing Program, 1965; Richards et al . , 
1966 a), and that non-academic accomplishment can be predicted with 
moderate success (Holland & Nichols, 1964; Richards _et , 1966b). 
The present study strengthens these earlier investigations in several 
ways. The sample is large and diverse with a full range of talent; 
it was drawn from a wide variety of colleges; and it was designed 
specifically to evaluate the relationships in question. The predictive 
data were collected as part of a college admissions testing program, 
while the criterion data were collected as part of a research project 
on which there was no incentive for students to dissimulate or exag- 
gerate their achievements. Moreover, for the first time the predictive 
data were obtained prior to college entrance. Finally, the use of 
both high school and college Infrequency scales provided evidence 
that the overall meaning and pattern of the predictive relationships 
is little effected by possible student distortion of their achievements. 

The present study establishes that it is possible to predict 
non-academic accomplishment with moderate success. Because the 
high school non-academic achievement scales are a regular part 




of a national college admission assessment, however, it is important 
to discuss in some detail the magnitude of the predictive validities 
and the implications of those magnitudes. 

It is clear that by conservative or traditional standards these 
validities are unsatisfactory. The median correlation between high 
school and college accomplishment in the same area is only . 25 when 
all students are considered and . 30 when high Infrequency students 
are eliminated. It must be remembered, of course, that the non- 
academic achievement scales are much shorter than the typical 
test of academic potential. Relative to their length, therefore, 
the validities of these brief scales with a short history of devel- 
opment compare rather favorably with the validities for typical tests 
of academic potential which have a history of development of about 
fifty years. There are a number of other reasons, however, for 
rejecting the negative verdict of conventional standards for test validity. 

First, at many colleges, freshmen are prevented by student 
regulations from participating in many of the activities tapped by the 
non-academic achievement scales. Therefore, even if the "true" 
validity of the high school achievement scales is high, the obtained 
validities would be lower in the freshman year. In an earlier study 
using similar scales, (Richards _et ^ , 1966b) we did find that the 
predictive validities of high school achievements increased as a 
function of the length of time students had been in college. Second, 
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it has long been known (Taylor & Russell, 1939) that quite low corre- 
lations yield satisfactory success ratios when selection ratios are 
moderate, and impressive success ratios when selection ratios are 
stringent. College admissions typically involve moderate to stringent 
selection ratios. Third, the skewed distributions of the scales impose 
real limits on the possible magnitude of the correlation. To a degree, 
therefore, to criticize the low validities is to argue with "nature" 
rather than with the non-academic achievement scales. The relatively 
high validities for self-reported high school grades support this 
interpretation. It is likely, moreover, that the Pearson correlations 
give a conservative estimate of how likely it is that a college achiever 
will have achieved in the same area in high school. 

The most important reason for rejecting the verdict of tradi- 
tional standards, however, is that the rationale for the non-academic 
achievement scales grows out of an entirely different conceptual 
framework than that of traditional standards. Traditional standards 
assume that only one decision is involved in evaluating a person's 
potential for success, whether or not he is likely to do well on 
a single criterion. On the other hand, the non-academic achievement 
scales are based on the assumption that there are many kinds of 
excellence, and therefore many criteria for us to predict. Conse- 
quently, evaluating a person's potential for success involves many 
decisions rather than a single one. Cronbach and Gleser (1957) 
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have convincingly shown that, in such a situation, many short teste 
with moderate or even low validities against several criteria are 
more appropriate than a single long test with a high validity against 
one criterion. 

A final objection to such devices can be dealt with more 
summarily. It is sometimes objected that if such devices were 
used in selecting college students, high schools would become 
aware of this and would encourage their students to participate in 
the kind of activities leading to high scores. But this would amount 
to encouraging their students to become actively involved in such 
important human endeavors as art, literature, drama, music, and 
science. Such an outcome hardly seems undesirable. 
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APPENDIX 



Intercorrelations of Predictors and Criteria 
for AU Students at Two-Year Colleges 
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